Game apparatus and information processing apparatus

ABSTRACT

A non-limiting example information processing apparatus comprises a housing, and a first portion of the housing is formed in an elliptical form when viewing from the front. A display panel and a touch panel constitute one main surface of the first portion. Holes are formed in left and right end portions of the display panel and the touch panel, and two operation sticks are provided through the two holes. When viewing the first portion from the front, an area except key tops of the operation sticks becomes a display area.

CROSS REFERENCE OF RELATED APPLICATION

The disclosure of the patent application No. 2014-119097 filed on Jun.9, 2014 is incorporated by reference.

FIELD

This application describes a game apparatus and an informationprocessing apparatus comprising an operation unit.

SUMMARY

It is a primary object of embodiments to provide a novel game apparatusand information processing apparatus.

A game apparatus of a first embodiment comprises a housing having adisplay panel that displays at least a virtual game space. Furthermore,the game apparatus comprises an operation unit having an operationportion and a detection portion. The operation unit provided penetratesthe display panel, and the detection portion is located inside thehousing and the operation portion is exposed outside the housing.

An information processing apparatus of a second embodiment comprises ahousing having a display panel. Furthermore, the information processingapparatus comprises a first operation unit having an operation portionand a detection portion. The first operation unit provided penetratesthe display panel, and the detection portion is located inside thehousing and the operation portion is exposed outside the housing.

A third embodiment is according to the second embodiment, wherein thedisplay panel has a hole through which the operation unit penetrates.

A fourth embodiment is according to the second embodiment, wherein theoperation portion is partially provided above the display panel in athickness direction of the housing, and the detection portion isprovided below the display panel, the thickness direction beingperpendicularity to a display surface of the display panel. That is, thefirst operation unit is provided so as to sandwich the display panel.

A fifth embodiment is according to the second embodiment, wherein thedisplay panel is an oblong form approximately.

A sixth embodiment is according to the second embodiment, wherein eachof left and right end portions of the display panel is a form of an arc.

A seventh embodiment is according to the second embodiment, wherein asize of a front surface of the housing approximately corresponds to asize of the display panel, and the display panel constitutes the frontsurface of the housing. Therefore, a first rim portion is maderelatively narrow.

An eighth embodiment is according to the fifth embodiment, wherein thedisplay panel is approximately elliptical form, and further comprises afirst rim portion along at least an arc portion of the display panel.

A ninth embodiment is according to the fifth embodiment, and furthercomprises a third rim portion close to one long side of the displaypanel, the third rim portion being larger than a second rim portionalong the other long side of the display panel.

A tenth embodiment is according to the fifth embodiment, and furthercomprises a fourth rim portion that is formed along one long side of thedisplay panel.

An eleventh embodiment is according to the second embodiment, andfurther comprises a touch panel capable of detecting a touch input tothe display panel and a position in a display area of the display panelcorresponding to the touch input.

A twelfth embodiment is according to the eleventh embodiment, whereinthe first operation unit provided also penetrates the touch panel, andthe operation portion is exposed outside the housing.

A thirteenth embodiment is according to the second embodiment, andfurther comprises a second operation unit having an operation portionlocated on a surface of the housing different from the surface on whichthe display panel is provided.

A fourteenth embodiment is according to the second embodiment, whereinthe first operation unit is provided in the display panel apart from acenter portion thereof.

A fifteenth embodiment is according to the fourteenth embodiment, andfurther comprises a third operation unit having an operation portion anda detection portion. The third operation unit provided penetrates thedisplay panel, and the detection portion is located inside the housingand the operation portion is exposed outside the housing. The firstoperation unit and the third operation unit are provided in a left sidearea and a right side area of the display panel, respectively.

A sixteenth embodiment is according to the fifteenth embodiment, whereinthe first operation unit and the third operation unit are provided in aleft end portion and a right end portion of the display panel,respectively.

A seventeenth embodiment is according to the second embodiment, whereinthe information processing apparatus is a hand-held type.

An eighteenth embodiment is according to the second embodiment, whereinthe operation portion of the first operation unit is provided in a rangethat a thumb of a user is placed when holding the housing.

A nineteenth embodiment is according to the second embodiment, whereinthe first operation unit can perform a direction input by tilting orsliding the operation portion.

A twentieth embodiment is according to the second embodiment, whereinthe first operation unit can perform a depression input by pushing downthe operation portion.

A twenty-first embodiment is according to the second embodiment, whereinthe first operation unit can perform a direction input in 360 degrees.

A twenty-second embodiment is according to the second embodiment, andfurther comprises a virtual space display module configured to displayon the display panel a virtual space image captured by a virtual camera.

A twenty-third embodiment is according to the second embodiment, andfurther comprises an initial screen display module configured to displayan initial screen on the display panel according to an operation inputby the operation portion.

A twenty-fourth embodiment is according to the second embodiment, andfurther comprises an operation button display module configured todisplay a content in a center portion of the display panel, and todisplay an operation button concerning operating the content near oraround the operation portion on the display panel.

A twenty-fifth embodiment is according to the second embodiment, andfurther comprises a motion detection module configured to detect amotion of the housing.

A twenty-sixth embodiment is according to the twenty-fifth embodiment,wherein the motion detection module includes at least one of anacceleration sensor and a gyro sensor. Therefore, an acceleration of acertain axis direction of the housing is detected, or an angularvelocity around a certain axis of the housing is detected.

A twenty-seventh embodiment is according to the second embodiment, andfurther comprises a vibrator configured to apply vibration to thehousing.

A twenty-eighth embodiment is according to the second embodiment, andfurther comprises an object display module configured to display anobject near the operation portion.

A twenty-ninth embodiment is according to the second embodiment, andfurther comprises an object display module configured to display anobject around the operation portion.

A thirtieth embodiment is according to the twenty-eighth embodiment, andfurther comprise a touch panel capable of detecting a touch input to theobject on the display panel.

A thirty-first embodiment is according to the thirtieth embodiment,wherein the object is supplementally displayed near the operationportion.

A thirty-second embodiment is according to the twenty-eighth embodiment,wherein the object is a character, a figure or a sign or symbol and canbe selected by a direction input of the operation portion.

A thirty-third embodiment is according to the twenty-eighth embodiment,wherein the object includes an operation history concerning theoperation portion. For example, an object representing an operationcontent of the operation portion is displayed according to a timeseries.

A thirty-fourth embodiment is according to the twenty-eighth embodiment,and further comprises a second operation unit having a second operationportion located in a surface different from the surface on which thedisplay panel is provided. The object includes operation historiesconcerning the first operation portion and the second operation portion.For example, objects representing an operation content of the firstoperation portion and an operation content of the second operationportion are displayed according to a time series.

A thirty-fifth embodiment is according to the twenty-eighth embodiment,wherein the object is an image effect.

A thirty-sixth embodiment is according to the second embodiment, andfurther comprises a screen display module configured to display a screenof an application on the display panel. The screen display modulechanges a size of the performing screen to be displayed on the displaypanel according to a kind of the application or a kind of a screen usedin the application. The screens having different aspect ratios aredisplayed, for example.

A thirty-seventh embodiment is according to the third embodiment, andfurther comprise a generating module configured to generate image datacorresponding to a display screen to be displayed on the display panel.The generating module generates the image data irrespective of thepresence or absence of a hole.

A thirty-eighth embodiment is an information processing apparatus,comprising: a housing having a display panel having a hole; and a firstoperation unit that is provided at least partially in the hole.

A thirty-ninth embodiment is an information processing apparatus,comprising: a housing having a display panel; and an operation unit thatis provided in a manner that at least a part thereof is embedded insidethe housing and penetrates the display panel.

A fortieth embodiment is an information processing apparatus,comprising: a housing having a display panel; and an operation unit thatis surrounded by the display panel when viewing from a front side andpenetrates the display panel.

A forty-first embodiment is an information processing apparatus,comprising: a housing having a display panel; and an operation unithaving an operation portion and a detection portion to detect an inputby the operation portion, wherein the operation unit is surrounded bythe display panel, the detection portion is located inside the housing,and the operation portion is exposed outside the housing.

A forty-second embodiment is according to the forty-first embodiment,wherein the display panel has a hole or notch through which theoperation unit penetrates.

The above described objects and other objects, features, aspects andadvantages of the embodiments will become more apparent from thefollowing detailed description when taken in conjunction with theaccompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIGS. 1(A) and 1(B) illustrate an appearance of a non-limiting exampleinformation processing apparatus of this embodiment, wherein FIG. 1(A)is a perspective view obliquely viewing down the information processingapparatus, and FIG. 1(B) is a front view viewing the informationprocessing apparatus from the front.

FIG. 2 is a partial cross-sectional view of the information processingapparatus.

FIGS. 3(A) and 3(B) illustrate a non-limiting example method of openinga hole in a touch panel of an electrostatic capacitance system, whereinFIG. 3(A) is an illustration view showing a state where electrodes of anX-axis direction and a Y-axis direction are overlapped, and FIG. 3(B) isan illustration view of a case where only the electrode of the Y-axisdirection in FIG. 3(A) is focused on.

FIG. 4(A) is an illustration view showing another non-limiting examplemethod of opening a hole in a touch panel of an electrostaticcapacitance system, and FIG. 4(B) is an illustration view showing anon-limiting example method of opening a hole in a touch panel of aresistance film system.

FIG. 5(A) is an illustration view showing a non-limiting example whenforming a notch in the touch panel of the electrostatic capacitancesystem, FIG. 5(B) is an illustration view showing a part of theelectrodes in the X-axis direction when forming the notch, and FIG. 5(C)is an illustration view showing a part of the electrodes of the Y-axisdirection when forming the notch.

FIGS. 6(A) to 6(C) are illustration views showing other examples whenforming a notch in the touch panel of the electrostatic capacitancesystem.

FIG. 7 is a circuit diagram showing a part of an electric circuitry of acommon LCD.

FIG. 8 is a circuit diagram showing a part of an electric circuitry whenopening a hole in the LCD.

FIG. 9(A) is an illustration view showing a manner that a firstoperation portion of two operation sticks is hidden when a player holdsthe information processing apparatus with both hands, and FIG. 9(B) isan illustration view intelligibly showing a relationship of fingers ofthe player and the two operation sticks when the player holds theinformation processing apparatus with both hands.

FIG. 10 is an illustration view showing a non-limiting example gamescreen displayed on the display panel of the information processingapparatus.

FIGS. 11(A) and 11(B) are illustration views showing a further exampleof the game screen displayed on the display panel of the informationprocessing apparatus.

FIG. 12 is an illustration view showing a further example of the gamescreen displayed on the display panel of the information processingapparatus.

FIG. 13 is an illustration view showing a further example of the gamescreen displayed on the display panel of the information processingapparatus.

FIG. 14 is an illustration view showing a further example of the gamescreen displayed on the display panel of the information processingapparatus.

FIG. 15 is an illustration view showing a non-limiting example characterinput screen displayed on the display panel of the informationprocessing apparatus.

FIG. 16(A) is an illustration view showing a non-limiting example mainmenu screen, and FIG. 16(B) is an illustration view showing anon-limiting example sub menu screen.

FIG. 17(A) is an illustration view showing a non-limiting examplebrowser screen when holding the information processing apparatushorizontally, and FIG. 17(B) is an illustration view showing anon-limiting example browser screen when holding the informationprocessing apparatus vertically.

FIG. 18 is an illustration view showing a non-limiting example gamescreen of a game of an old version.

FIG. 19 is a block diagram showing non-limiting example electricstructure of the information processing apparatus.

FIG. 20 is an illustration view showing a non-limiting example memorymap of a RAM shown in FIG. 19.

FIG. 21 is a flowchart showing non-limiting example help processing of aCPU shown in FIG. 19.

FIG. 22 is a flowchart showing a non-limiting example replay processingof the CPU shown in FIG. 19.

FIG. 23 is a flowchart showing a part of non-limiting example characterinput processing of the CPU shown in FIG. 19.

FIG. 24 is a flowchart showing another part of the non-limiting examplecharacter input processing of the CPU shown in FIG. 19, following FIG.23.

FIG. 25 is a flowchart showing a non-limiting example correctionprocessing of the CPU shown in FIG. 19.

DETAILED DESCRIPTION OF NON-LIMITING EXAMPLE EMBODIMENTS

With reference to FIG. 1, a non-limiting example information processingapparatus 10 includes a housing 12, and a display panel 14 constitutesone main surface (front surface) of the housing 12. As the display panel14, an LCD, EL, etc. can be used, for example. Furthermore, as thedisplay panel 14, it is possible to use a display panel allowingstereoscopic view with naked eyes. In such a case, an LCD of a parallaxbarrier system or an LCD of a lenticular system using a sheet withunevenness (lenticular lens) is used, for example.

The housing 12 is an oblong form, and it is constituted by a firstportion 12 a having an elliptical form or approximately elliptical formwhen viewing from the front, and two grip portions 12 b that areintegrally formed with the first portion 12 a and respectively extendedobliquely downward from a lower side of the first portion 12 a.Therefore, a user or player (hereinafter, simply called “player”) canhold the housing 12 with one hand or both hands.

Since the display panel 14 constitutes the front surface of the housing12 as mentioned above, this display panel 14 is also an oblong form. Asseen from FIG. 1(A) and FIG. 1(B), the display panel 14 has the same orapproximately the same form and size as those of the elliptical form ofthe front surface of the first portion 12 a. In addition, the displaypanel 14 is an elliptical form with a long side at a lower end is made aform of a straight line.

Furthermore, since the display panel 14 is fit into the front surface ofthe first portion 12 a, when viewing from the front, an edge (rimportion) 30 is formed in the circumference of the display panel 14 dueto a thickness of a side wall of the first portion 12 a, etc. The rimportion 30 is formed along the elliptical form of the display panel 14,but formed along a straight line in a part of a lower end of the displaypanel 14. Therefore, in the part of the lower end of the display panel14, the rim portion 30, i.e., a non-display portion is made wider(larger) than other portions. A reason why the rim portion 30 in thepart of the lower end of the display panel 14 is large is that aplurality of LEDs for a back light of the display panel 14 (LCD) isprovided linearly.

Furthermore, since the rim portion 30 is formed along the ellipticalform except the part of the lower end of the display panel 14 and theelliptical form of the front surface of the first portion 12 a and theelliptical form (except for the part of the lower end) of the displaypanel 14 are approximately the same size, the rim portion 30 is lessenedas much as possible. Therefore, when holding the information processingapparatus 10 with both hands, portions other than the display panel 14of the information processing apparatuses 10 become invisible as much aspossible in the front side (see FIGS. 9(A) and 9(B)). Therefore, it isthought that the player who views the virtual space displayed on thedisplay panel 14 obtains a high feeling of immersion into the virtualspace.

In addition, although a plurality of LEDs are provided in the lower endportion of the information processing apparatus 10 in this embodiment,these may be provided in an upper end portion. Furthermore, it ispossible to construct such that a plurality of LEDs are provided in atleast one of a left end portion and a right end portion of theinformation processing apparatus 10.

Furthermore, since the plurality of LEDs are provided in the lower endportion of the information processing apparatus 10 linearly in thisembodiment, it is possible to cause the player who sees a game screen100 (see FIG. 9-FIG. 14, and FIG. 18) described later to recognize therim portion 30 of the lower end portion of the first portion 12 a as aground surface of a game space. Furthermore, when arranging theplurality of LEDs in the upper end portion of the information processingapparatus 10 linearly, the rim portion 30 is formed in the upper endportion, and therefore, it can be recognized as a ceiling etc. of thegame space.

In addition, the plurality of LEDs for a back light may be providedalong a curved line of the elliptical form. In such a case, the rimportion 30 is formed along an elliptical form throughout an entirecircumference of the display panel 14, and a portion that the pluralityof LEDs are provided is made wider (larger) in comparison to otherportions.

Furthermore, since the display panel 14 is made into an oblong form asmentioned above, it is possible to make an aspect ratio thereofcomparable to a ratio (16:9) of a wide screen.

Although not shown in FIG. 1(A) and FIG. 1(B), a touch panel 16 isprovided on the front surface of the display panel 14, and the touchpanel 16 is set the same form (size) as the display panel 14 in thisembodiment. That is, the touch panel 16 is also an oblong form, and anelliptical form that a part of a long side of a lower end is made into aform of a straight line. Therefore, it is possible to perform a touchinput in almost a whole of a display area of the display panel 14.However, the touch panel 16 may be an elliptical form as similar to theform of the front surface of the first portion 12 a. Furthermore, as thetouch panel 16, a touch panel of an electrostatic capacitance system ora resistance film system can be used.

In this embodiment, unless otherwise especially noted, when describingthe embodiment using directions, up, down, left and light directionswhen viewing the information processing apparatus 10 from the front asshown in FIG. 1(B) and a direction perpendicular to a surface of a pieceof paper of FIG. 1(B), i.e., a thickness direction of the informationprocessing apparatus 10 are used. In addition, a surface opposite to thefront surface is a rear surface.

Furthermore, the information processing apparatus 10 comprises a firstoperation stick 18 a, a second operation stick 18 b, a first operationbutton 20 a and a second operation button 20 b. The first operationstick 18 a is provided in a position operable by the thumb of the lefthand when the player holds the information processing apparatus 10 withone hand or both hands, and similarly, the second operation stick 18 bis provided in a position operable by the thumb of the right hand.Furthermore, the first operation button 20 a is provided in a positionoperable by the index finger of the left hand when the player holds theinformation processing apparatus 10 with both hands, and similarly, thesecond operation button 20 b is provided in a position operable by theindex finger of the right hand. In this embodiment, the first operationbutton 20 a and the second operation button 20 b are provided on a sidesurface of the first portion 12 a. More specifically, the firstoperation button 20 a is provided in a left end portion of an uppersurface of the housing 12, and the second operation button 20 b isprovided in a right end portion of the upper surface of the housing 12.

Furthermore, a card slot 40 is provided in a center portion of the uppersurface of the housing 12. The card slot 40 can be attached with variouskinds of card storage media such as a game cartridge, an SD card, a SIM(Subscriber Identity Module) card, etc. Therefore, the informationprocessing apparatus 10 reads (acquires) a program and data from thecard storage medium that is attached to the card slot 40, or writes aprogram and data into a card storage medium. It should be noted that theprogram is a program for an application such as a game, and the data isdata used for processing of the application. Furthermore, in some cases,a personal authentication may be performed.

In addition, although omitted in FIG. 1(A) and FIG. 1(B), theinformation processing apparatus 10 comprises a speaker 64 (see FIG.19), and the speaker 64 is provided inside the housing 12, for example.However, a hole for outputting a sound from the speaker 64 to outsidethe housing 12 is provided in a portion other than the display area ofthe display panel 14, i.e., a side surface or the rear surface of thehousing 12.

In a common game apparatus, a display panel is provided between one ormore operation buttons to be operated by the left hand and one or moreoperation buttons to be operated by the right hand on the surface(front) of the housing.

Accordingly, if it is intended to miniaturize a game apparatus, it isnecessary to reduce the number of the operation buttons, to make a sizeof the operation button small, or to make a size of the display panelsmall. On the other hand, a game apparatus becomes large if it isintended to enlarge a size of the display panel.

Therefore, this embodiment provides a new information processingapparatus 10 by enlarging a size of the display panel while notenlarging the apparatus.

Specifically, as shown also in FIG. 2, the first operation stick 18 aand the second operation stick 18 b are provided to be embedded in thedisplay panel 14 and the touch panel 16. As described later, since thedisplay panel 14 is almost the same as the form and the size of thefirst portion 12 a of the housing 12 when viewing from the front, andthe display panel 14 is formed with the holes 32 for embedding theoperation sticks (18 a, 18 b) only, it is possible to use almost allareas except the area that the holes 32 are provided as a display area.

Furthermore, the first operation stick 18 a and the second operationstick 18 b are provided in the left side and the right side of the firstportion 12 a (housing 12) excluding center portion of the display panel14. In this embodiment, the first operation stick 18 a is provided in arange that the thumb of the left hand of the player who holds thehousing 12 reaches in an end portion of the left side of the firstportion 12 a. Furthermore, the second operation stick 18 b is providedin a range that the thumb of the right hand of the player who holds thehousing 12 reaches in an end portion of the right side of the firstportion 12 a. That is, the first operation stick 18 a is provided in theend portion of an area in the left side of the display panel 14, and thesecond operation stick 18 b is provided in the end portion of an area onthe right side of the display panel 14.

In addition, FIG. 2 shows a partial cross-section of the informationprocessing apparatus 10 in order to show attachment structure of thefirst operation stick 18 a. Hereinafter, the first operation stick 18 ais explained, but the second operation stick 18 b is also the same.

As shown in FIG. 2, in this embodiment, the first operation stick 18 ais a hardware operation unit, and includes a key top portion 1800, ashaft portion 1802 and a detection portion 1804. Briefly describing, thedisplay panel 14 and the touch panel 16 are formed with the hole 32 thatpenetrates them, and the first operation stick 18 a is provided in amanner that the shaft portion 1802 passes the hole 32. That is, thefirst operation stick 18 a is provided so as to project from the rearside to the front side of the display panel 14 and the touch panel 16.Therefore, the first operation stick 18 a is surrounded by the displaypanel 14. When viewing the information processing apparatus 10 (housing12) from the front, the key top (operation portion) of the firstoperation stick 18 a is embedded within the display area of the displaypanel 14.

Here, the operation portion means a portion to which the playercontacts, and typically, is a portion to which a finger for the usercontacts. For example, a surface portion of the key top portion 1800 ofthe operation stick (18 a and 18 b), a surface portion of a crossbutton, a surface portion of a depressible button, an oblong surfaceportion of an operation button (20 a and 20 b) described later, asurface portion of a direction operation stick of a slide system, anouter peripheral surface of a wheel of a jog dial, etc. correspond tothe operation portion.

Furthermore, in FIG. 2, the key top portion 1800 of the first operationstick 18 a is provided above a display surface of the display panel 14and a detection surface of the touch panel 16 (front side of thethickness direction). That is, the first operation stick 18 a isprovided such that the key top is exposed outside the housing 12.Furthermore, as shown also in FIG. 2, the first operation stick 18 a isprovided such that a lower end portion of the key top portion 1800 liesabove the detection surface of the touch panel 16. Therefore, since thefirst operation stick 18 a is hard to be brought into contact to thesurface of the display panel 14, it is possible to prevent the surfaceof the display panel 14 from being damaged. Although the key top portion1800 is formed in a form of an equilateral pentagon, it may be formed inother polygon form or circular form. A size of the surface of the keytop portion 1800 is made larger than a size (diameter) of theabove-mentioned hole 32. Therefore, the hole 32 is not visible when theinformation processing apparatus 10 is seen from the front (see FIGS.1(A) and 1(B)).

The detection portion 1804 pivotally supports the shaft portion 1802 ofthe first operation stick 18 a and detects a direction that the key topportion 1800 and the shaft portion 1802 are tilted, and outputsinformation about a detected direction (direction designating signal).This detection portion 1804 is provided below the display panel 14 andthe touch panel 16. Thus, the first operation stick 18 a is embedded inthe display panel 14 and the touch panel 16. Furthermore, the detectionportion 1804 is electrically connected to a circuit board 1230 describedlater, and designation of a direction (direction input signal) istransmitted to a CPU 50 mounted on the circuit board 1230.

In an inside of the first portion 12 a, there is provided with a wall1200 that stands up in the thickness direction of the housing 12 fromthe bottom surface of the information processing apparatus 10 (housing12). There is provided with a thin-plate like elastic member (flatspring) 1210 having one end portion that is secured to the wall 1200with a screw 1220 and the other end portion that is secured to thedetection portion 1804. Therefore, the first operation stick 18 a (thekey top portion 1800 and shaft portion 1802) is depressible to the rearside of the housing 12, and is returned to its home position (positionshown in FIG. 2) by a restoring force of the flat spring 1210.Furthermore, the circuit board 1230 is provided on the bottom of thehousing 12. A tact switch 1240 is mounted on the circuit board 1230 soas to form a line in the first operation stick 18 a on a straight lineof the thickness direction of the housing 12. In fact, the circuit board1230 is provided to be slightly separated from the bottom using a spaceretc. As mentioned above, if the first operation stick 18 a is pusheddown toward the rear side of the housing 12, the detection portion 1804is brought into contact to the tact switch 1240, and the tact switch1240 is turned on. Since circuit components such as a CPU 50 describedlater are also mounted on the circuit board 1230, a signal (signal of adepression input) that the tact switch 1240 is turned on is given to theCPU 50.

Therefore, as for the first operation stick 18 a, it is possible toperform not only an operation (tilting operation) that the key topportion 1800 and the shaft portion 1802 are tilted in an arbitrarydirection (direction in 360 degrees) such as up, down, left, right andoblique directions when viewing the housing 12 from the front but alsoan operation that the key top portion 1800 and the shaft portion 1802are pushed down(depression) toward the rear side of the housing 12.

Thus, since the operation stick (18 a, 18 b) is provided by opening thehole 32 in the display panel 14 and the touch panel 16 in thisembodiment, the electrodes provided in an inside of each of the displaypanel 14 and the touch panel 16 are made to detour along the hole 32.

As shown in FIG. 3 (A), in a portion that the hole 32 is formed in thetouch panel 16 of an electrostatic capacitance system, the electrode(ITO transparent electrode, for example) that should pass the positionthat the hole 32 is formed is made to detour so as to pass outside thehole 32. In addition, in the touch panel 16, an ITO film is providedindependently in an X-axis direction and Y-axis direction. Therefore, asshown in FIG. 3(A), the ITO transparent electrode 1600 of the X-axisdirection is made to detour along the hole 32, and as understood well byFIG. 3(B) showing only the ITO transparent electrode 1602 of the Y-axisdirection, the ITO transparent electrode 1602 of the Y-axis directiononto which the ITO transparent electrode 1600 of the X-axis direction issuperposed is also made to detour along the hole 32. Thus, when the ITOtransparent electrode 1600 and the ITO transparent electrode 1602 aremade to detour, detection precision of the touch panel 16 falls in thisportion; however, if this portion is excluded from a detection range,the other detection range is not affected at all because the hole 32 ishidden by the key top portion 1800 of the operation stick (18 a, 18 b).

Furthermore, image generating processing (rendering) for displaying animage (the game screen 100, a character input screen 200 (see FIG. 15)described later, etc.) on the display panel 14 is performed such that animage to be displayed on a normal display panel 14 without the hole 32is generated. As mentioned above, since there are no semiconductorelements in a portion of the hole 32 of the display panel 14, the imageis not only displayed in the portion. Therefore, a portion that theelectrode is made to detour becomes black in the display panel 14.

Furthermore, as shown in FIG. 4(A), in place of making the ITOtransparent electrodes 1600 and 1602 detour, the ITO transparentelectrodes 1600 and 1602 may be respectively divided in the portion ofthe hole 32 and divided portions may be connected to each other by ametal wire (metal wiring). In such a case, it is possible to lower aresistance value in comparison to a case where the ITO transparentelectrodes 1600 and 1602 are made to detour.

Furthermore, in a case where a 4-wire type touch panel 16 of aresistance film system is used, in the portion that the hole 32 isopened, the resistance file may be sealed as shown in FIG. 4(B).

In addition, FIG. 3 and FIG. 4 are mere illustration, in fact, thenumber of the electrodes is determined according to the detectionprecision of the touch panel 16 (resolution in a case of the displaypanel 14), and a plurality of electrodes are made to detour in theportion that the hole 32 is provided. Furthermore, as another example,by arranging a plurality of touch panels (of the electrostaticcapacitance system or resistance film system) to avoid the portion ofthe hole 32, and by detecting a touch input to each of the plurality oftouch panels, a touch input by the player to a portion except theportion of the hole 32 may be made possible.

FIG. 5(A) shows an example of a case where the touch panel 16 of anelectrostatic capacitance system is formed with a notch 34 instead ofthe hole 32. As shown in FIG. 5(A), the notch 34 has a width somewhatlarger than the diameter of the shaft portion 1802 of the firstoperation stick 18 a or the second operation stick 18 b, and is formedtoward a lower part from a position that the shaft portion 1802 isprovided. Therefore, even if it is in a case where the first operationstick 18 a and the second operation stick 18 b cannot be disassembledinto the key top portion 1800, the shaft portion 1802 and the detectionportion 1804, it is possible to attach the first operation stick 18 aand the second operation stick 18 b through the notch 34 of the displaypanel 14 and the touch panel 16. Furthermore, even if it is in a casewhere the first operation stick 18 a and the second operation stick 18 bcan be disassembled into the key top portion 1800, the shaft portion1802 and the detection portion 1804, it is possible to attach thesewithout disassembly.

When forming the notch 34 as shown in FIG. 5(A), for example, as shownin FIG. 5(B) and FIG. 5(C), the ITO transparent electrodes 1600 and 1602are made to detour or avoid the notch 34, respectively in the touchpanel 16. Even if the ITO transparent electrodes 1600 and 1602 are madeto detour, since such a portion is hidden with the thumb of the playerwho holds the information processing apparatus 10 (see FIG. 9), not onlythe content displayed on the display panel 14 does not have a badinfluence but also there is no inconvenience in particular as an areathat a touch input cannot be performed.

In addition, although FIG. 5(B) and FIG. 5(C) show the ITO transparentelectrode 1600 of the X-axis direction and the ITO transparent electrode1602 of the Y-axis direction separately, these are provided in theportion that the same notch 34 is formed in layers.

Furthermore, the notch 34 does not need to be limited to a form shown inFIG. 5(A), and may be formed in other forms. As shown in FIG. 6 (A), forexample, the notch 34 may be formed to obliquely extend toward a lowerpart from a position that the shaft portion 1802 is provided.

Furthermore, although the notch 34 is formed to extend downward as shownin FIG. 5(A), a portion around the shaft portion 1802 and the otherportion may be different in size (width) as shown in FIG. 6(B). A reasonis that it is necessary to cut relatively largely in the portion aroundthe shaft portion 1802 since the shaft portion 1802 is tilted, but theshaft portion 1802 is not tilted in the other portion, while the shaftportion 1802 passes through the other portion at the time that theinformation processing apparatus 10 is assembled.

Furthermore, as shown in FIG. 6(C), the notch 34 that lower end portionsof the right and left of the display panel 14 are cut off in a fan formmay be formed. This is because such a portion is partly hidden by thethumb of the player and also deviates from an effective visual fielddescribed later. If such structure is adopted, assembly of theinformation processing apparatus 10 is easy.

In addition, although illustration is omitted, even if the notch 34 isformed as shown in FIG. 6(A)-FIG. 6(C), the ITO transparent electrodes1600 and 1602 are made to detour or avoid the notch 34 like a case shownin FIG. 5(B) and FIG. 5(C).

FIG. 7 is a circuit diagram showing a part of an electric circuitry of acommon LCD that is an example of the display panel 14. As shown in FIG.7, in the LCD, a plurality of leads (wiring) are formed in vertical andhorizontal directions, and each square of a grid formed with these leadscorresponds to a pixel. In the LCD, one TFT (Thin Film Transistor) isprovided for each pixel. FIG. 7 shows a circuit diagram for 8 pixels×8pixels. Furthermore, although vertical lead and horizontal leadintersect in FIG. 7 (FIG. 8 is also the same), these are not connected.In each pixel, the TFT functions as a switch to turn a pixel electrodeon or off. Furthermore, a gate of each TFT is connected to thehorizontal lead (gate electrode line), and a source of each TFT isconnected to the vertical lead (source electrode line). Then, a pixelelectrode is connected to a drain of the TFT in each pixel.

A controller of the LCD controls the LCD to draw one by one line(progressive scan). Therefore, when a line to be drawn is determined,and a gate voltage is applied to the determined line, and a sourcevoltage is applied to each vertical lead, a current flows between thesource and the gate of each TFT that the gate is connected to thedetermined line, and a source voltage is applied to each pixel electrodeconnected to each TFT. For example, N line is drawn by applying the gatevoltage to a second line from the top in FIG. 7 and applying the sourcevoltage to each vertical lead. When the N line is drawn, N+1 line isdrawn next. Thus, drawing is performed for each line from the first lineto the last line. Furthermore, by changing the source voltage, thevoltage applied to the pixel electrode is changed, and thus, thestrength (tone) of a light is expressed.

As described above, when forming the hole 32, as shown in FIG. 8, theTFT and the pixel electrode are omitted in the portion that the hole 32is formed. In the example shown in FIG. 8, the TFTs and the pixelelectrodes are omitted for 4 pixels×4 pixels in center. Furthermore,about the portion that the hole 32 is formed, the vertical lead andhorizontal lead are respectively made to detour along the hole 32.

Thus, as for the pixels in the portion that the hole 32 is formed,although the portion that the leads are made to detour becomes darkbecause the TFTs and the electrodes are omitted, the darkened portion isusually hidden by the key top portions 1800 of the first operation stick18 a and the second operation stick 18 b and therefore, invisible to theplayer. Furthermore, when the player operates the first operation stick18 a and the second operation stick 18 b, even if these are tilted, theabove-mentioned darkened portion is hidden with the thumb of the player.Therefore, it is thought that it does not cause the player to feeluncomfortable, and there is no inconvenience in particular by havingformed the hole 32 in the display panel 14.

In addition, although illustration is omitted, the vertical leads andthe horizontal leads are made to detour or avoid the notch 34 in also acase where the notch 34 is formed in the display panel 14 instead of thehole 32, like a case the notch 34 is formed in the touch panel 16.

Furthermore, the first operation button 20 a and the second operationbutton 20 b are hardware operation units, and each includes an oblongoperation portion that the player operates (depresses). As shown in FIG.1(A) and FIG. 1(B), an operation portion is provided in right and leftside surfaces of an upper side of the housing 12. That is, the key topsof the first operation button 20 a and the second operation button 20 bare provided in the surface different from the surface that the displaypanel 14 is provided out of the housings 12. Thus, the first operationbutton 20 a and the second operation button 20 b are provided inpositions that the player can operate with fingers when holding thehousing 12 in an area except an area (portion) that the display panel 14is provided of the housing 12. Therefore, the operation button (20 a, 20b) may be provided in the rear side of the housing 12.

One end portion in the horizontal direction of each of the firstoperation button 20 a and the second operation button 20 b is pivotallysupported by the housing 12, and the other end portion is rotated withthe axis of the one end portion. In addition, the other end portion isprovided with a coil spring between the housing 12, and if the finger isreleased from the operation portion after the player pushes down(depresses) the first operation button 20 a or the second operationbutton 20 b with the finger, the other end portion of the firstoperation button 20 a or the second operation button 20 b returns to thehome position due to the restoring force of the coil spring.Furthermore, a switch board is provided inside the housing 12, and aswitch of the switch board is turned on by depressing the firstoperation button 20 a or the second operation button 20 b. Since theswitch board is electrically connected to the above-mentioned circuitboard 1230, a signal (signal of a depression input) that the switch ofthe switch board is turned on is also applied to the CPU 50.

In addition, each of the first operation button 20 a and the secondoperation button 20 b has one end portion close to a right end and aleft end of the housing 12 is pivotally supported and the other endportion close to the center of the housing 12 is made as a free end.However, each of the first operation button 20 a and the secondoperation button 20 b may be constituted in a manner that the one endportion is made as a free end and the other end portion is pivotallysupported.

FIG. 9(A) and FIG. 9(B) show an example of a case where a virtual gamespace (game screen 100) is displayed on the display panel 14 of theinformation processing apparatus 10 and the player plays a game. Thegame screen 100 is an image that the virtual game space in which apredetermined object is provided is imaged by a virtual camera.Specifically, a predetermined character or predetermined object such asa background, a person etc. is provided (rendered) in athree-dimensional space such as the virtual game space, and atwo-dimensional image that is viewed from the virtual camera (viewpoint)is generated. That is, an image of the three-dimensional space viewedfrom the viewpoint is projected on a two-dimensional virtual screen byviewpoint conversion processing such as perspective projectiontransformation, and a projected two-dimensional image is displayed asthe game screen 100.

FIG. 9(A) shows a manner that the key top portions 1800 of the firstoperation stick 18 a and the second operation stick 18 b are hidden whenthe player holds the information processing apparatus 10 with bothhands. On the other hand, FIG. 9(B) intelligibly indicates relationshipsof the fingers of the player to the first operation stick 18 a and thesecond operation stick 18 b.

As mentioned above, the information processing apparatus 10 is held bythe player with both hands. As shown also in FIG. 9(A) and FIG. 9(B), atthis time, the left thumb is placed on the key top portion 1800 of thefirst operation stick 18 a and the right thumb is placed on the key topportion 1800 of the second operation stick 18 b, for example.Furthermore, a left index finger is brought into contact to the firstoperation button 20 a in a depressible manner and a right index fingeris brought into contact to the second operation button 20 b in adepressible manner, for example. Then, the left side grip portion 12 bis held by a palm, middle finger, fourth finger and little finger of theleft hand and in a similar manner, the right side grip portion 12 b isheld by a palm, middle finger, fourth finger and little finger of theright hand, for example.

In this embodiment, since the first portion 12 a is an elliptical formwhen viewed from the front, and each of the right and left end portionsof the first portion 12 a is made a semi-circular form or approximatelysemi-circular form, and therefore, it is easy for the player to hold thefirst portion 12 a (housing 12), i. e., the information processingapparatus 10. That is, since each of the right and left end portions ofthe first portion 12 a (housing 12) is formed in a form of arc, when theplayer holds the information processing apparatus 10 (housing 12) byhand, a finger being bent is along a side surface of each of the rightand left end portions. Therefore, it is easy to hold. Each of the rightand left end portions of the display panel 14 is also formed in a formof arc. It should be noted that the form of arc means a state of beingcurved like a bow, it is not necessary for each of the right and leftend portions of the housing 12 when viewing the housing from the frontto be necessarily a part of a (perfect) circle, to become to beprojected outward like a bow. Therefore, the display panel 14 is in aform similar to a form of the visual filed of the human being asdescribe later.

A player character 102 is displayed on a background image 104 in anexample of the game screen 100 shown in FIG. 9(A) and FIG. 9(B). Theplayer character 102 performs an arbitrary action according to anoperation by the player. In the example of the game screen 100 shown inFIG. 9(A) and FIG. 9(B), a manner that the player character 102 moves(runs) on a mountain path according to an operation of the player isshown. The game of this embodiment is an action role playing game, andaccording to the operation of the player, the player character 102 movesin the virtual game world, fights with an enemy character including aboss character, acquires an item, and/or uses an item.

In this embodiment, as mentioned above, the display panel 14 is providedso as to occupy almost a whole of the front surface of the first portion12 a that is an elliptical form or approximately elliptical form whenviewing from the front, and the game screen 100 is displayed on a wholeof a display surface (display area). For example, the elliptical form orapproximately elliptical form of the display panel 14 is the same orapproximately the same as a form that visual filed ranges of both eyesare composed with each other. Therefore, in a case where the playerholds the information processing apparatus 10 with a predetermineddistance (30 cm, for example) from the own eye, for example, theeffective visual field including a discriminable visual filed agrees orapproximately agrees with a center portion of the game screen 100, and astable field of fixation covers an entire range of the game screen100(whole of the display area of the display panel 14).

In addition, the discriminable visual filed means a high-densityinformation processing range (less than about 5 degrees in the center)that is excellent in visual performance such as eyesight. Furthermore,the effective visual field means a range that an eye-gaze can be movedin an instant and information acceptance is possible in high efficiency(level: ±15 degrees, upper: 8 degrees, lower: 12 degrees). Then, thestable field of fixation means a range that information acceptance ispossible by movement of an eyeball and a head reasonably (level: ±30degrees-45 degrees, upper: 20 degrees-30 degrees, lower: 25 degrees-30degrees).

Since the game screen 100 is displayed within a range that is thuscovered by not only the effective visual field but the stable field offixation, it is possible to display an image such as the playercharacter 102 to be noted within the effective visual field, and animage around the image to be noted outside the effective visual field.Therefore, it is possible to enhance a feeling of immersion into thevirtual space (game).

Therefore, in this embodiment, an operation stick (18 a, 18 b) is notprovided in a center area in the front surface of the first portion 12 asuch as the discriminable visual filed and the effective visual field,and the operation stick is provided in each of the right and left endportions of the first portion 12 a so as to avoid the image to be notedbecomes difficult to be seen. That is, the operation stick (18 a, 18 b)is provided in a position that does not become an obstacle of the imageto be noted.

In addition, in this embodiment, it is thinkable that since the ownthumb overlaps on the image (game screen 100) of the virtual space to beseen, a higher feeling of immersion can be obtained by the player.

FIG. 10 shows a further example of the game screen 100. In the gamescreen 100 shown in FIG. 10, a button image 110 is displayed near thesecond operation stick 18 b. If the button image 110 is touched, forexample, according to this, an instruction that is set to the buttonimage 110 is input. Therefore, by assigning to the button image 110 aninstruction different from an instruction that is input when depressingthe second operation stick 18 b, it is possible to input more variegatedinstructions. Furthermore, if the button image 110 is displayedsupplementally (or additionally or supportively) to the second operationstick 18 b in a range near the second operation stick 18 b and the thumbon the right hand of the player reaches, it is possible to use thesecond operation stick 18 b and the button image 110 as such a pushbutton of the common game controller.

In addition, a position that displays the button image 110 may be setarbitrarily by the player. For example, if the button image 110 isdisplayed in a range near the first operation stick 18 a and the leftthumb reaches, it is also possible to make it button arrangement that iseasy to operate for the player of a left-handed player who operates apush button with the left thumb. Furthermore, the button image 110 maybe displayed outside the first operation stick 18 a or the secondoperation stick 18 b, whereby the center part of the game screen 100 canbe made conspicuous.

Furthermore, the button image 110 should just be displayed at a propertiming such as a case of being required for operation of a game, anddoes not need to be displayed always.

In addition, although a detailed description is omitted, in thisembodiment, a coordinate system of the display panel 14 and a coordinatesystem of the touch panel 16 are made the same, and therefore, the CPU50 can know a position in a display area of the display panel 14corresponding to a touch position based on the touch coordinate datacorresponding to a touch input. This is true in the following.

FIG. 11(A) and FIG. 11(B) show a further example of the game screen 100.An enemy character 106 is displayed in a screen center of the gamescreen 100 shown in FIG. 11(A), and the player character 102 turns tothe enemy character 106. Furthermore, near each of the first operationstick 18 a and the second operation stick 18 b, a plurality of itemimages 120 are displayed. Although illustration is omitted, a backgroundimage is also displayed in the game screen 100 shown in FIG. 11(A) (FIG.11(B) is the same).

On the game screen 100 shown in FIG. 11(A), by touching the item image120, an item can be used. Since the item image 120 is thus displayednear the first operation stick 18 a and the second operation stick 18 b,it is possible to use an item by selecting a desired item by a touchinput and depressing the first operation stick 18 a or the secondoperation stick 18 b near the item, for example. This is an example andshould not be limited. When instructing the use of an item, the firstoperation stick 18 a or the second operation stick 18 b should just bepushed.

In addition, the item image 120 is displayed about the item that theplayer character 102 owns. Furthermore, the item image 120 should justbe displayed according to a predetermined timing (event) such as a casewhere there is a displaying instruction by the player or a case ofbattling against the enemy character 106, and does not need to bedisplayed always.

In the game screen 100 shown in FIG. 11(A), for example, if the itemimage 120 that an image of a gun is drawn is selected (touched), it isdetermined that the player character 102 uses a gun object 108. Then,the game screen 100 as shown in FIG. 11(B) becomes to be displayed onthe display panel 14. The game screen 100 shown in FIG. 11(B) is drawnwith a first-person viewpoint of the player character 102, and a part ofhand of the player character 102 is displayed. Furthermore, since havingdetermined the use of the gun object 108 as mentioned above, the gunobject 108 is grasped by the hand of the player character 102. A pointthat the enemy character 106 is displayed in the screen center is thesame as the game screen 100 of FIG. 11(A). Furthermore, since the itemto be used is selected, the item image 120 is non-displayed in the gamescreen 100 shown in FIG. 11(B).

As shown also in FIG. 11(B), the part of the hand of the playercharacter 102 and the gun object 108 are displayed near the secondoperation stick 18 b. For example, an operation that makes the gunobject 108 move or shoot a bullet is performed by the second operationstick 18 b. Therefore, since the gun object 108 is displayed near thethumb of the player, a feeling that the player is directly operating thegun object 108 is obtained.

That is, since the game screen 100 drawn from the first-person viewpointis displayed on the display panel 14 having a form similar to a form ofthe visual filed of the human being, the player can obtain a feeling ofimmersion into the virtual game space. Furthermore, since the gun object108 is displayed near the thumb of the player, it is thought that ahigher feeling of immersion can be obtained.

FIG. 12 shows a further example of the game screen 100. In the gamescreen 100 shown in FIG. 12, an enemy character 106 is displayed in thescreen center and a background image 104 in a manner that a spark isscattered in part and is full of smoke is displayed. Furthermore, anobject (flame object) 130 that imitates flames is displayed around thefirst operation stick 18 a and the second operation stick 18 b. Forexample, it is shown a situation that by operating at least one of thefirst operation stick 18 a and the second operation stick 18 b by theplayer, the player character is caused to emit the flame to attack theenemy character 106 with the spark and smoke generated by the flame.Thus, by displaying an image effect corresponding to a physicaloperation of the player around the operation stick (18 a, 18 b), it ispossible to display the game screen 100 with ambience. Therefore, it ispossible to more raise a feeling of immersion.

However, the game screen 100 shown in FIG. 12 is an example, and shouldnot be limited. For example, in a music game, when making the playertilt or depress the first operation stick 18 a and/or the secondoperation stick 18 b according to the music, images of music notes maybe displayed near the first operation stick 18 a or the second operationstick 18 b according to such an operation. Furthermore, in a roleplaying game, when making the player character acquire an item accordingto an operation of the first operation stick 18 a and/or the secondoperation stick 18 b, the image effect indicative of having acquired theitem may be displayed near or around the first operation stick 18 a orthe second operation stick 18 b. Furthermore, in an action game, whenmaking the player character attack the enemy character according to anoperation of the first operation stick 18 a and/or the second operationstick 18 b, the image effect indicating the attack having succeeded orgone wrong may be displayed near or around the first operation stick 18a or the second operation stick 18 b.

FIG. 13 shows a further example of the game screen 100. In the gamescreen 100 shown in FIG. 13, a player character 102 and a backgroundimage 104 are displayed as shown in FIG. 9(A) and FIG. 9(B).Furthermore, in the game screen 100 shown in FIG. 13, an index image 140indicative of a help mode is displayed in an upper end portion in thescreen center and a character string of “help mode” is displayed belowthe same. Furthermore, a guide image 142 is displayed near the firstoperation stick 18 a. Here, the guide image 142 is displayed in the gamescreen 100 in contact with the first operation stick 18 a or its key topin appearance. Similarly, a guide image 144 is displayed near the secondoperation stick 18 b. Similarly, a moving image 146 is displayed nearthe first operation button 20 a. The guide images 142, 144 and 146 areimages for explaining an operation content (the content of instructions)of corresponding touch panel 16, operation stick (18 a, 18 b) andoperation button (20 a, 20 b). In addition, the guide images 142 and 144explain not only the operation content but an operation method.Therefore, it can be understood that if tilting the first operationstick 18 a in a direction that the guide image 142 is extended, it ispossible to move the player character 102 in the virtual space in thedirection that the guide image 142 is extended in the screen, forexample. It can be understood that if depressing the second operationstick 18 b, it is possible to make the player character 102 jump. Then,it can be understood that if pushing the first operation button 20 a, itis possible to make the player character 102 squat.

Such the guide images 142, 144 and 146 are displayed at a predeterminedtiming such as a case where the player selects the help mode (instructsto display the guide), a case where the game is started or a case wherethere is no operation by player beyond a predetermined time period.

Furthermore, although one guide image (142, 144, 146) is displayedcorresponding to each input portion of the first operation stick 18 a,the second operation stick 18 b and the first operation button 20 a inthis embodiment, not necessary to be limited to this. For example, if aplurality of operations (instructions) can be performed by a pluralityof different operation methods for one input portion, it is alsopossible to display a guide image for each of the plurality of operationmethods. For example, since the direction input and the depression inputare possible for the operation stick (18 a, 18 b), when an operationcorresponding to each is assigned, the guide image corresponding to theassigned operation is displayed.

FIG. 14 shows a further example of the game screen 100. In the gamescreen 100 shown in FIG. 14, a player character 102 in a manner ofthrowing an object (ball object) 110 that imitates a ball is displayed.Furthermore, near the first operation stick 18 a, an arrow mark (guideimage) 150 that points a predetermined direction (here, left slantupper) is displayed, and a guide image 152 that is for indicating thatthe first operation stick 18 a is tilted in a direction that the arrowmark points and imitates the key top portion 1800 of the first operationstick 18 a is displayed while being blinked, for example. In FIG. 14, adotted line shows that the guide image 152 is blinking. However, it isnot necessary to make blink. Furthermore, near the guide image 150, acharacter string of “tilt” is displayed. Furthermore, the guide image154 that shows that the second operation stick 18 b is to be pushed isdisplayed around the second operation stick 18 b, and a character stringof “push” is displayed near this guide image 154.

The game screen 100 as shown in FIG. 14 is displayed when replaying thegame processing based on an operation of the player, for example. Forexample, a history of operation by the player (history of operationdata) is stored from the start to the end of the game together with atime period (absolute time) after the game start, and a play image bythe player is reproduced (replayed) based on the history of theoperation data (hereinafter called “replay data”). At this time, theguide images (150, 152, 154, etc.) representing the history of theoperation performed by the player using the touch panel 16, operationstick (18 a, 18 b) and operation button (20 a, 20 b) (history of theoperation content and the operation method) are displayed on the gamescreen 100. Therefore, the player can see the history of the operationwhen playing the game together with the play image.

Therefore, by acquiring the replay data of other player and replayingthe same, the player can see the operation content and the operationmethod of the other player together with the play image, for example.Furthermore, as similar to the replay data, by acquiring data (exemplardata) including the operation data that becomes an exemplar for playingand the absolute time period from the game start and replaying theexemplar data, the player can see the contents of operation and theoperation methods of the exemplar together with the play image.

However, it is not necessary to store a whole of the replay data or theexemplar data from the start to the end of the game, and the replay dataor the exemplar data about an arbitrary part may be sufficient.

Furthermore, replay (reproduction) processing is performed according toan operation of the player or according to a predetermined event duringthe game.

FIG. 15 shows an example of a character input screen 200. A display area202 that displays an input character in the screen center is formed inthe character input screen 200 shown in FIG. 15. Guide images 204 forinputting a consonant (Japanese “a”-“wa” columns) are displayed aroundthe first operation stick 18 a. Furthermore, guide images 206 forinputting a vowel (rows of syllables on the Japanese syllabary tablethat ends with the vowel sound “a”-“o”) and punctuation are displayedaround the second operation stick 18 b.

In addition, in the example of the character input using the characterinput screen 200 shown in FIG. 15, when Japanese Hiragana are put inorder according to the Japanese syllabary table, the Hiragana decidedwith a consonant (“a”-“wa” columns) and a vowel (vowel sound “a”-“o”) isinput.

If the player makes the first operation stick 18 a tilt, a consonantbeing displayed in a tilted direction is selected. If the firstoperation stick 18 a is pushed down in a state where the consonant isselected, the consonant being selected is decided as a consonant of acharacter to be input. Similarly, if the second operation stick 18 b ismade to tilt, a vowel being displayed in a tilted direction is selected.If the second operation stick 18 b is pushed down in a state where thevowel is selected, the vowel being selected is decided as a vowel of acharacter to be input. Accordingly, a character based on the decidedconsonant and the decided vowel is decided, and a decided character isinput. Although illustration is omitted, the characters being input aredisplayed on the upper end portion of the display area 202 in order.

In addition, if pushing down the second operation stick 18 b in a statewhere a period or comma is selected by tilting the second operationstick 18 b, a period or comma in a selected state is decided. In thiscase, the period or comma being decided is input as it is.

In addition, a vowel and a consonant should just be decided wheninputting a character, and it does not need to be limited to a decidingorder.

In the example shown in FIG. 15, a direction that the operation stick(18 a, 18 b) is tilted is indicated by a white arrow mark. Furthermore,in the example shown in FIG. 15, a situation that “a” column is decidedas a consonant and vowel sound “u” is decided as a vowel, and thus,Japanese Hiragana “u” is input is shown. In addition, in FIG. 15, bygiving slant lines to the background of a character, it is indicatedthat the above-mentioned column and vowel sound are selected or decided.

Furthermore, although a case where a character is to be input isdescribed in the example shown in FIG. 15, it does not need to belimited to the case where a character is to be input. It is possible toselect the content that is indicated by the image displayed near oraround the first operation stick 18 a or the second operation stick 18 bby tilting the first operation stick 18 a or the second operation stick18 b, and further, to decide the selected content by depressing thefirst operation stick 18 a or the second operation stick 18 b. Byselecting and deciding the item image 120 in the game screen 100 shownin FIG. 11 by such an operation method, for example, it becomes possibleto use the item.

In addition, such the character input screen 200 is displayed accordingto an instruction by the player or at an arbitrary timing that acharacter is to be input.

Although a case where Japanese Hiragana is input is described in thisembodiment, it does not need to be limited to this. It is also possibleto input the alphabet. In such a case, it is unnecessary to decide avowel and a consonant unlike Japanese Hiragana, by making the operationstick (18 a, 18 b) tilt to input the alphabet currently displayed in thetilted direction as it is.

Furthermore, although a case where a character is input is described inthis embodiment, numerals and symbols or signs may be input, or figures(character images) may be input.

Furthermore, in such an information processing apparatus 10, on thefront side of the display surface of the display panel 14, the touchpanel 16 is provided and the key top portions 1800 of the firstoperation stick 18 a and the second operation stick 18 b are alsoprovided. Therefore, when the first operation stick 18 a or the secondoperation stick 18 b is tilted, for example, the thumb may touch thetouch panel 16. Furthermore, when the touch panel 16 is being touched,the finger having touched is brought into contact to the operation stick(18 a, 18 b), and the operation stick (18 a, 18 b) may be tilted. Insuch a case, in addition to the direction input of the first operationstick 18 a or the second operation stick 18 b, the touch input of thetouch panel 16 is applied.

Therefore, in this embodiment, in a case where the direction input ofthe first operation stick 18 a and/or the second operation stick 18 b isreceivable and the touch input of the touch panel 16 is also receivable,by invalidating the input received later, information processingcorresponding to the operation that the player does not intend is notperformed.

That is, when the touch input of the touch panel 16 is applied in astate where the direction input of at least one of the first operationstick 18 a and the second operation stick 18 b is applied, the touchinput is invalidated. In this embodiment, the touch coordinate databased on a touch input is deleted. Therefore, the information processingis not performed based on the touch input.

However, this is a mere example and does not need to be limited. Forexample, what is necessary is, in the above-mentioned case, just toavoid touching to the touch panel 16 by the tilting operation wheninputting the direction input in a case where the direction input of atleast one of the first operation stick 18 a and the second operationstick 18 b is applied. Therefore, it may be made to invalidate a touchinput about a range (invalid range) somewhat larger than a range thatthe key top portion 1800 of the first operation stick 18 a and thesecond operation stick 18 b can be tilted (moved). By determining suchan invalid range in advance, in a case where the direction input of atleast one of the first operation stick 18 a and the second operationstick 18 b is applied, the touch coordinate data corresponding to thetouch input detected in the invalid range that is determined in advanceshould just be deleted. In this case, by determining the touch input ofthose other than the invalid range is an intentional touch input of theplayer, it is possible to perform the information processing accordingto this touch input.

On the other hand, when the direction input of at least one of the firstoperation stick 18 a and the second operation stick 18 b is applied in acase where the touch input of the touch panel 16 is applied, thedirection input data corresponding to the direction input isinvalidated. The direction input data is deleted in this embodiment.Therefore, the information processing based on this direction input datais not performed.

Furthermore, when performing the information processing (processing ofapplication) while receiving both of the touch input of the touch panel16 and the direction input of the first operation stick 18 a and/or thesecond operation stick 18 b, the correction processing mentioned aboveis unnecessary.

FIG. 16(A) shows an example of a main menu screen 300. A plurality ofmenu icons 302 are displayed in the screen center in the main menuscreen 300 shown in FIG. 16 (A). A predetermined operating system isinstalled in the information processing apparatus 10, for example, andthe menu icon 302 is an icon for various kinds of applications thatoperates on this operating system.

The main menu screen 300 is an initial screen that is displayed on thedisplay panel 14 when the information processing apparatus 10 isstarted, for example, and the main menu screen 300 is also displayed onthe display panel 14 at a time that the performance of the arbitraryapplication of the information processing apparatus 10 is terminated,and at a time that a predetermined operation input is performed whiledisplaying a sub menu screen 350 as shown in FIG. 16(B). In this mainmenu screen 300, it is possible to perform a desired application byselecting a desired menu icon 302. For example, the predeterminedoperation input is an operation depressing the first operation stick 18a or the second operation stick 18 b.

It is assumed that a desired application is performed in the main menuscreen 300 shown in FIG. 16(A), and then, the sub menu screen 350 asshown in FIG. 16(B) is displayed on the display panel 14. For example,when selecting a piece of music in a music player or a music game, whenselecting a course in a racing game or action game that a plurality ofcourses is prepared, etc., the sub menu screen 350 is displayed. Submenus 352 are displayed in the sub menu screen 350. The player canselect (determine) a desired sub menu 352 by a touch input. If the firstoperation stick 18 a or the second operation stick 18 b is pushed downwhen such a sub menu screen 350 is currently displayed, the screenreturns to the main menu screen 300 as shown in FIG. 16(A).

FIG. 17(A) and FIG. 17(B) show an example of a browser screen 400. FIG.17(A) shows an example of the browser screen 400 when holding theinformation processing apparatus 10 horizontally, and FIG. 17(B) showsan example of the browser screen 400 when holding the informationprocessing apparatus 10 vertically.

The browser screen 400 shown in FIG. 17(A) is sideways, and a displayarea 402 for displaying a content (web page, for example) in the screencenter is formed in this browser screen 400. Furthermore, information404 such as a date, a day of week, battery residual quantity and a timeis displayed near or around the first operation stick 18 a. Furthermore,five (5) operation buttons 406 are displayed near or around the secondoperation stick 18 b. By making the first operation stick 18 a or thesecond operation stick 18 b tilt, for example, it is possible to scrolla web page displayed on the display area 402 in a tilted direction, orto move a page in a tilted direction. Furthermore, the operation button406 is an icon for performing a predetermined operation that isdifferent from scrolling and movement of a page in the browser screen400. Specifically, in the example shown in FIG. 17(A) and FIG. 17(B),zoom-in, zoom out, display of a web site, close page and registration ofpage address are assigned to each of the operation buttons 406. However,the function of scrolling and the function of movement of page may beassigned to the operation button 406.

Furthermore, as shown in FIG. 17(B), by holding the informationprocessing apparatus 10 vertically, the browser screen 400 may bedisplayed vertically. In such a case, the above-mentioned display of theinformation 404 and the operation buttons 406 is rotated (here, rotatedcounterclockwise) by 90 degrees, and therefore, an up and down directionis displayed correctly. Furthermore, the content (web page) displayed onthe display area 402 is also turned vertically. In addition, displayingthe browser screen 400 vertically is set according to an operation ofthe player, or is set automatically by detecting a direction of theinformation processing apparatus 10 based on an output of anacceleration sensor or a gyro sensor as described later.

In addition, it is also possible to hold the information processingapparatus 10 vertically to display the browser screen 400 vertically,while turning the second operation stick 18 b up.

Thus, since the information 404 and the operation buttons 406 aredisplayed near or around the first operation stick 18 a and the secondoperation stick 18 b in the browser screen 400, the content is notdisturbed. Furthermore, since the operation buttons 406 are provided(displayed) around the second operation stick 18 b and thus means toperform an operation concerning the browser or content is gathered inone place, it is easy to operate it.

FIG. 18 shows a further example of a game screen 100 a. The game screen100 a shown in FIG. 18 is displayed between the first operation stick 18a and the second operation stick 18 b. For example, a game of the gamescreen 100 a shown in FIG. 18 is a game of an old version of theabove-mentioned game, and a size of a screen is not equivalent to a sizeof the display panel 14 of the information processing apparatus 10.Furthermore, because of the game of an old version, a screen design isnot created supposing the hole 32 or the notch 34 formed in the displaypanel 14. For example, the image data of the game screen 100 a isgenerated for a display panel of an aspect ratio of 4:3.

In addition, in FIG. 18, slant lines are applied to an area that noimage is displayed in the display panel 14. In fact, this shadow areabecomes black.

That is, in the information processing apparatus 10, a displaying methodof a screen can be changed corresponding to a kind of an applicationsuch as an aspect ratio of a screen generated by the application to beperformed, a version of an application to be performed, etc. Althoughthe game of different version is described here, it is possible toarbitrarily change the displaying method of the screen corresponding toarbitrary applications.

FIG. 19 is a block diagram showing electric structure of the informationprocessing apparatus 10 shown in FIG. 1. As shown in FIG. 19, theinformation processing apparatus 10 includes the CPU 50, and the CPU 50is connected with the above-mentioned touch panel 16, and furtherconnected with a RAM 52, a flash memory 54, a wireless communicationmodule 56, a display driver 58, an operation input unit 60, a D/Aconverter 62 and a card interface (card I/F) 66. The above-mentioneddisplay panel 14 is connected to the display driver 58, and a speaker 64is connected to the D/A converter 62. The operation input unit 60 isconstituted by the first operation stick 18 a, the second operationstick 18 b, the first operation button 20 a and the second operationbutton 20 b all mentioned above.

The touch panel 16 inputs the touch coordinate data corresponding to atouch position into the CPU 50 in response to the touch input by theplayer. Furthermore, the operation input unit 60 inputs operation datainto the CPU 50 corresponding to an operation of the player. In thisembodiment, the operation data includes at least one of the directioninput data from the operation stick (18 a, 18 b), the depression datafrom the operation sticks (18 a, 18 b) and the depression data from theoperation button (20 a, 20 b). The CPU 50 stores into the RAM 52 theoperation data that is input from the operation input unit 60 accordingto a time series, and uses it for the processing (informationprocessing) of applications such as a game. In addition, strictly, thedepression data based on depression of the operation sticks (18 a, 18 b)is input into the CPU 50 from the tact switch 1240.

The CPU 50 is in charge of the entire control of the informationprocessing apparatus 10. The RAM 52 is used as a working memory and abuffer memory for the CPU 50. The flash memory 54 is used in order tostore a program of an application such as a game or to store (save)various kinds of data.

The wireless communication module 56 has a function to connect awireless LAN. Therefore, the information processing apparatus 10 cancommunicate with computer(s) or other information processingapparatus(es) 10 directly or via a network. Therefore, it is possible totransmit and receive programs and data to or from other computer(s) orother information processing apparatus(es) 10. For example, the programand data of the application such as a game are distributed from othercomputer(s). Furthermore, it is possible to play a communication gamewith other computer(s) or other information processing apparatus(es) 10.

Under instructions of the CPU 50, the display driver 58 is used fordisplaying various screens such as the game screen 100 and the characterinput screen 200 on the display panel 14. In addition, the CPU 50 uses apart of the RAM 52 as a video RAM (VRAM) to generate the image datacorresponding to various screens.

The D/A converter 62 converts sound data applied from the CPU 50 into ananalog game sound to output to the speaker 64. In addition, the gamesound means a sound required for the game such as an imitation sound ofa game character or object, a sound effect and music (BGM).

Furthermore, the CPU 50 is electrically connected to the card storagemedium that is attached to the card slot 40 of the informationprocessing apparatus 10 via the card I/F 66, and reads a program anddata from the card storage medium or writes a program and data in thecard storage medium.

In addition, the electric structure of the information processingapparatus 10 shown in FIG. 19 is a mere example, and does not need to belimited to this.

For example, the information processing apparatus 10 may be providedwith at least one of an acceleration sensor and a gyro sensor. Forexample, the acceleration sensor is an acceleration sensor of anelectrostatic capacitance type, and detects each acceleration of each ofa right-and-left axis direction, up-and-down axis direction andthickness axis direction of the information processing apparatus 10.However, the acceleration sensor may be a 2-axis acceleration sensor.Furthermore, the gyro sensor is a gyro sensor of a piezoelectricvibration type, and detects angular velocities about a right-and-leftaxis, up-and-down axis and thickness axis of the information processingapparatus 10. However, the gyro sensor may be a 2-axis gyro sensor.

In this case, the direction of the information processing apparatus 10is detected based on an output of the acceleration sensor or the gyrosensor, and the direction of the screen to be displayed on the displaypanel 14 may be changed according to the direction of the informationprocessing apparatus 10. In addition, the output of the accelerationsensor or the gyro sensor may be used as the instructions of the player.For example, the motion of the housing 12 may be detected according tothe output of the acceleration sensor or the gyro sensor according tothe direction that the player inclines the housing 12 or the directionthat the player moves the housing 12 such that a moving direction of themoving object in the virtual space can be changed, or the direction ofthe virtual camera in the virtual space can be changed.

The information processing apparatus 10 may be provided with a vibrator.For example, the vibrator is a vibrating motor or a solenoid, and isprovided in the inside of the housing 12, and applies the vibration tothe housing 12. Therefore, the vibration is propagated to the fingers ofthe player holding the housing 12. Thus, by having the vibrator, theinformation processing apparatus 10 can generate vibration according tothe operation input using the touch panel 16 or the operation input unit60, or can generate vibration according to progress of a game, forexample.

FIG. 20 shows an example of a memory map 500 the RAM 52 shown in FIG.19. As shown in FIG. 20, the RAM 52 includes a program storage area 502and a data storage area 504.

As mentioned above, a part or whole of the program and the datadescribed later can be acquired from other computer(s) or otherinformation processing apparatus(es) 10 via the communication, or fromthe card storage medium that is attached to the information processingapparatus 10.

The program storage area 502 stores an application program (informationprocessing program) such as a game program. In this embodiment, the gameprogram is constituted by a main processing program 502 a, acommunication program 502 b, a screen generating program 502 c, a screendisplaying program 502 d, an operation detecting program 502 e, a helpprocessing program 502 f, a replay processing program 502 g, a characterinput program 502 h, a correction program 502 i, etc.

The main processing program 502 a is a program for processing a mainroutine of the game of this embodiment. The communication program 502 bis a program for communicating with other computer(s) and otherinformation processing apparatus(es) 10. The screen generating program502 c is a program for generating image data corresponding to variousscreens such as the game screen 100, the character input screen 200 etc.using the image generating data 504 b described later. The screendisplaying program 502 d is a program for outputting the image dataproduced according to the screen generating program 502 c to the displaypanel 14.

The operation detecting program 502 e is a program for detecting theoperation data from the touch panel 16 and the operation input unit 60,and storing to the data storage area 504 according to a time series.

The help processing program 502 f is a program for displaying the guideimage (142, 144, and 146 in example shown in FIG. 13) about theoperation input unit 60 on the screen like the game screen 100 using theoperation guide data 504 c described later. In addition, the helpprocessing program 502 f is executed at a predetermined timing like acase where the player selects the help mode (instructs to display theguide), a case where the game is started or a case where there is nooperation by player beyond a predetermined time period, as mentionedabove.

The replay processing program 502 g is a program for performing gameprocessing according to the replay data 504 d described later. Inaddition, the replay processing program 502 g displays the guide images(150, 152, 154 in example shown in FIG. 14) corresponding to theoperation data included in the replay data 504 d using the operationguide data 504 c described later near or around the operation input unit60 in the game screen 100 at a timing that the operation data is input.Furthermore, the replay processing program 502 g is executed accordingto the operation of the player or a predetermined event in the game, asmentioned above.

The character input program 502 h is a program for inputting a characterby deciding a consonant and a vowel or deciding a punctuation. Althoughillustration is omitted, the data for displaying the input character isstored in the flash memory 54 of the information processing apparatus 10in advance. Furthermore, the character input program 502 h is executedaccording to the operation of the player or according to a predeterminedcharacter input event. The data (input character data) 504 ecorresponding to the input character or character string is stored intothe data storage area 504 as described later.

The correction program 502 i is a program for invalidating the directioninput if the direction input from at least one of the first operationstick 18 a and the second operation stick 18 b is input in a case wherethe touch input from the touch panel 16 exists, and reversely,invalidating the touch input if the touch input from the touch panel 16is input in a case where the direction input from at least one of thefirst operation stick 18 a and the second operation stick 18 b exists.

Although illustration is omitted, the game program includes a soundoutput program, a backup program, etc. The sound output program is aprogram for generating and outputting a sound required for a game. Thebackup program is a program for saving game data.

Furthermore, in the data storage area 504, operation data 504 a, theimage generating data 504 b, the operation guide data 504 c, the replaydata 504 d, the consonant data 504 e, vowel data 504 f and inputcharacter data 504 g are stored.

The operation data 504 a is operation data from the touch panel 16 andthe operation input unit 60, and is stored according to a time series.The image generation data 504 b is data of polygon data, texture data,etc. for generating the image data. The operation guide data 504 c isimage data about various kinds of guide images (142, 144, 146, 150, 152and 154 in this embodiment). The replay data 504 d is a history of theoperation data at the time that the player or other player plays a game,and the operation data is stored with the absolute time after the gamestart.

The consonant data 504 e is data about the consonant decided accordingto the character input program 502 h. The vowel data 504 f is data aboutthe vowel decided according to the character input program 502 h. Theinput character data 504 g is data about a character or character stringdecided according to the character input program 502 h.

Furthermore, a stick flag 504 h and a touch flag 504 i are provided inthe data storage area 504.

The stick flag 504 h is a flag for distinguishing whether the key topportion 1800 and the shaft portion 1802 of the first operation stick 18a or the second operation stick 18 b are tilted, and consists of a 1-bitregister. When the key top portion 1800 and the shaft portion 1802 ofthe first operation stick 18 a or the second operation stick 18 b aretilted, the stick flag 504 h is turned on and “1” is set to theregister. On the other hand, when the key top portion 1800 and the shaftportion 1802 of the first operation stick 18 a and the second operationstick 18 b are not tilted, the stick flag 504 h is turned off and “0” isset to the register.

The touch flag 504 i is a flag for distinguishing whether the touchinput is performed in the touch panel 16, and consists of a 1-bitregister. When the touch input is performed to the touch panel 16, thetouch flag 504 i is turned on and “1” is set to the register. On theother hand, when the touch input is not performed to the touch panel 16,the touch flag 504 i is turned off and “0” is set to the register.

Although illustration is omitted, the data storage area 504 is storedwith other data required for execution of the game program, and providedwith other flags and counters (timers) for execution of the gameprogram.

FIG. 21 is a flowchart showing processing (help processing) in the helpmode of the CPU 50 shown in FIG. 19. As mentioned above, the CPU 50starts the help processing at a predetermined timing when the playerselects the help mode (instructs to display the guide), when the game isstarted or when there is no operation by the player beyond apredetermined time period, and the guide image is read in a step S1 asshown in FIG. 21. Here, the data of the guide image (the operationmethod may be included) of the contents of the operation assigned toeach of the first operation stick 18 a, the second operation stick 18 b,the first operation button 20 a and the second operation button 20 b isread from the operation guide data 504 c.

In a next step S3, the guide image that is read in the step S1 isdisplayed near the corresponding operation input unit 60. Therefore, thegame screen 100 as shown in FIG. 12 is displayed on the display panel14.

Then, it is determined, in a step S5, whether the help mode is to beended. Here, the CPU 50 determines whether the end of the help mode isinstructed from the player or a timing that the help mode is to be endedis reached. If “NO” is determined in the step S5, that is, the help modeis not to be ended, the process returns to the step S3 with nooperation. On the other hand, if “YES” is determined in the step S5,that is, if it is the end of the help mode, the help processing isterminated.

FIG. 22 is a flowchart showing replay processing of the CPU 50 shown inFIG. 19. As mentioned above, the CPU 50 starts the replay processingaccording to the operation of the player, or according to thepredetermined event during the game, and initializes a variable n (n=1)in a step S31. The variable n is used in order to read the operationdata according to a time series.

In a next step S33, it is determined, with reference to the replay data504 d, whether it is the read timing of the n-th operation data. Thatis, the CPU 50 determines whether the absolute time after starting thereplay processing reaches the absolute time that is stored correspondingto the n-th operation data.

If “NO” is determined in the step S33, that is, if it is not the readtiming of the n-th operation data, in a step S35, the game processingnot according to the operation data, and in a step S37, the game screen100 (image data) is renewed according to a result of the gameprocessing, and the process returns to the step S33. For example, in thestep S35, the CPU 50 moves a non-player character like the enemycharacter 106 that performs an arbitrary action such as movementirrespective of the operation of the player, or changes a backgroundimage (background object).

On the other hand, if “YES” is determined in the step S33, that is, ifit is the read timing of the n-th operation data, the n-th operationdata is read in a step S39, the guide image (operation method may beincluded) of the contents of the operation corresponding to readoperation data is displayed near or around the operation input unit 60(18 a, 18 b, 20 a, 20 b) in a step S41. Here, the CPU 50 reads the dataof the guide image from the operation guide data 504 c.

In a next step S43, the game processing according to the read operationdata is performed. Here, the CPU 50 makes the player character 102perform arbitrary action or fight against the enemy character 106according to the operation data, for example. Furthermore, the gamescreen 100 (image data) is renewed according to the result of the gameprocessing, in a step S45.

Then, it is determined, in a step S47, whether the replay is to beended. Here, the CPU 50 determines whether the play image is replayedfrom the start to the end of the game according to the replay data 504d. If “NO” is determined in the step S47, that is, if it is not the endof the replay, the variable n is incremented by 1 (one) (n=n+1) in astep S49, and the process returns to the step S33. On the other hand, if“YES” is determined in the step S47, that is, if it is the end of thereplay, the replay processing is terminated.

FIG. 23 and FIG. 24 are flowcharts showing character input processing ofthe CPU 50 shown in FIG. 19. As mentioned above, if the character inputprocessing is started according to the operation of the player oraccording to a predetermined character input event, the CPU 50 displaysan initial character input screen 200 on the display panel 14 in a stepS61. Here, the CPU 50 uses a part of the RAM 52 as the VRAM, andgenerates the image data of the initial screen of the character inputscreen 200 as shown in FIG. 15 using the image generating data 504 b andthe operation guide data 504 c to display (output) on the display panel14 via the display driver 58. Although illustration is omitted, when thecharacter input processing is started, the consonant data 504 e and thevowel data 504 f are deleted.

In a next step S63, the operation data is acquired. Here, the CPU 50detects the operation data that is input from the touch panel 16 and theoperation input unit 60 (18 a, 18 b, 20 a, 20 b), and stores the sameinto the data storage area 504.

In a next step S65, it is determines whether there is any tilting of thefirst operation stick 18 a. That is, the CPU 50 determines whether thedirection input data of the first operation stick 18 a is detected. Thisis true for a step S73 described later. If “NO” is determined in thestep S65, that is, if there is no tilting of the first operation stick18 a, the process proceeds to a step S69 with no operation. On the otherhand, if “YES” is determined in the step S65, that is, if there is thetilting of the first operation stick 18 a, a consonant is selectedaccording to the tilted direction in a step S67, and the processproceeds to a step S69. In addition, in the step S67, when a consonantis selected, the CPU 50 notifies to the player that the consonant isselected by heightening brightness or changing a color of the consonantbeing selected or display area thereof. This is true for a step S75described later.

In the step S69, it is determined whether there is any depression of thefirst operation stick 18 a. That is, the CPU 50 determines whether thedepression data of the first operation stick 18 a is detected. This istrue for a step S77 described later. If “NO” is determined in the stepS69, that is, if the depression data of the first operation stick 18 ais not detected, the process proceeds to a step S73 shown in FIG. 24with no operation. On the other hand, if “YES” is determined in the stepS69, that is, if the depression data of the first operation stick 18 ais detected, the consonant being selected is decided as a consonant ofthe character to be input in a step S71, and the process proceeds to astep S73. That is, in the step S71, the CPU 50 stores the consonant data504 e corresponding to the decided consonant into the data storage area504.

As shown in FIG. 24, it is determined, in the step S73, whether there isany tilting of the second operation stick 18 b. If “NO” is determined inthe step S73, that is, if there is no tilting of the second operationstick 18 b, the process proceeds to a step S77 with no operation. On theother hand, if “YES” is determined in the step S73, that is, if there isthe tilting of the second operation stick 18 b, a vowel or punctuationis selected according to the tilted direction in the step S75.

In the step S77, it is determined whether there is any depression of thesecond operation stick 18 b. If “NO” is determined in the step S77, thatis, if there is no depression of the second operation stick 18 b, theprocess proceeds to a step S83 with no operation. On the other hand, if“YES” is determined in the step S77, that is, if there is the depressionof the second operation stick 18 b, it is determines, in a step S79,whether a vowel or a punctuation being selected is decided as a vowel ora punctuation of a character to be input, and it is determined whetherthe punctuation is decided in a step S81. In addition, when the vowel isdecided, the CPU 50 stores the vowel data 504 f corresponding to thedecided vowel into the data storage area 504 in the step S79.

If “YES” is determined in the step S81, that is, if the punctuation isdecided, the decided period or comma is input in a step S83, and theprocess proceeds to a step S89. In the step S83, the CPU 50 adds thedata of the decided period or comma to the input character data 504 g.On the other hand, if “NO” is determined in the step S81, that is, ifthe vowel is decided, it is determined, in a step S85, whether both theconsonant and the vowel are decided. Here, the CPU 50 determines whetherboth the consonant data 504 e and the vowel data 504 f are stored in thedata storage area 504.

If “NO” is determined in the step S85, that is, if at least one of theconsonant and the vowel is not decided, the process returns to the stepS63 shown in FIG. 23. On the other hand, if “YES” is determined in thestep S85, that is, if both the consonant and the vowel are decided isinput, in a step S87, the character that is decided with the consonantand the vowel having been decided, and the process proceeds to the stepS89. In addition, in the step S87, the CPU 50 adds the datacorresponding to the decided character to the input character data 504g. Furthermore, although illustration is omitted, after performing theprocessing of the step S87, the consonant data 504 e and the vowel data504 f are deleted.

In the step S89, it is determined whether it is the end of the characterinput. Here, the CPU 50 determines whether there is an end instructionof the character input from the player, or there is any end event of thecharacter input. If “NO” is determined in the step S89, that is, if itis not the end of the character input, the process returns to the stepS63. On the other hand, if “YES” is determined in the step S89, that is,if it is the end of the character input, the character input processingis terminated.

FIG. 25 is a flowchart showing correction processing of the CPU 50 shownin FIG. 19. This correction processing is performed when both the touchcoordinate data of the touch panel 16 and the direction input data ofthe operation stick (18 a, 18 b) are detected simultaneously. Inaddition, although illustration is omitted, separately from thiscorrection processing, processing that turns on or off the stick flag504 h according to the presence or absence of the tilting of theoperation stick (18 a, 18 b) is performed. Similarly, processing thatturns on or off the touch flag 504 i according to the presence orabsence of the touch input to the touch panel 16 is also performed.

As shown in FIG. 25, the CPU 50 starts the correction processing if thetouch input and the direction input are simultaneously detected, anddetermines, in a step S101, whether it is necessary to perform thecorrection. That is, the CPU 50 determines whether the game processingis to be performed according to the touch coordinate data or thedirection input data.

If “NO” is determined in the step S101, that is, if there is nonecessity for correction, in a step S103, both the touch coordinate dataand the direction input data are output to the processing of theapplication (game), and the correction processing is terminated. On theother hand, if “YES” is determined in the step S101, that is, if thereis necessity for correction, it is determined, in a step S105, whetherthe stick flag 504 h is on.

If “YES” is determined in the step S105, that is, if the stick flag 504h is on, it is determined that the touch input is performed to the touchpanel 16 in a state where the operation stick (18 a, 18 b) is tilted,and in a step S109, the direction input data is output to the processingof the application, and the correction processing is terminated. Thatis, the touch coordinate data is deleted in a step S109.

On the other hand, if “NO” is determined in the step S105, that is, ifthe stick flag 504 h is off, it is determined, in a step S107, whetherthe touch flag 504 i is on. If “NO” is determined in the step S107, thatis, if the touch flag 504 i is off, the process proceeds to a step S109.On the other hand, if “YES” is determined in the step S107, that is, ifthe touch flag 504 i is on, in a step S111, the touch coordinate data isoutput to the processing of the application, and the correctionprocessing is terminated. That is, the direction input data is deletedin a step S111.

In addition, in this embodiment, when the direction input and the touchinput are performed simultaneously from a state there are no directioninput by means of the operation stick (18 a, 18 b) and no touch input bymeans of the touch panel 16, the priority is given to the directioninput. However, if the priority is to be given to the touch input, when“NO” is determined in the step S105, the process should just proceed tothe step S111 without performing determination processing in the stepS107.

According to this embodiment, since the hole is opened in the displaypanel and the touch panel and the operation stick is embedded therein,it is possible to enlarge the display surface without enlarging theinformation processing apparatus.

In addition, although a form of the first portion is made into anelliptical form when viewing from the front in this embodiment, it doesnot need to be limited to this. For example, the first portion is madein a track form, oval form or square form when viewing from the front,or a form approximating to them. When the first portion is made into thetrack form or the oval form when viewing from the front, the both endportions of the first portion are made into the form of a semi-circle orapproximately semi-circle.

In addition, although two operation sticks are provided in thisembodiment, the number of the operation sticks may be one.

Furthermore, although the operation stick that a direction input and adepression input are possible is embedded in the display panel and thetouch panel in this embodiment, other input means may be made to beembedded. For example, a cross button that a direction input is possiblemay be embedded, a push button that a depression input is possible maybe embedded or both the cross button and the push button may beembedded. In addition, the cross button and the push button may beembedded instead of the operation stick or may be embedded together withthe operation stick.

Furthermore, in this embodiment, although the operation stick designatesa direction by tilting the key top portion and the shaft portion, theydo not need to be limited to this. By making the key top portionapproximately parallel to the surface of the display panel, and bysliding the key top in an arbitrary direction, a direction can bedesignated.

In addition, although a tact switch is provided to detect the depressionof the operation stick in this embodiment, it does not need to belimited to this. For example, an operation stick that has a detectionportion capable of detecting not only that the key top portion and theshaft portion are tilted but also that the operating stick is depressedmay be provided. In such a case, the operation stick is fixed to theinside of the housing such that the detection portion itself is notdisplaced.

Furthermore, the detection portion included in the operation stick isnot limited to the structure of the above-mentioned embodiment. Forexample, the detection portion may be a fixed contact that is providedon the bottom of the depressible button to detect that the button isdepressed, and further can include all device or member provided withinthe housing to detect a predetermined operation against the operationportion by the player.

Furthermore, although the hole is opened in the display panel and thetouch panel, and the operation stick is embedded in them in thisembodiment, it does not need to be limited to this. For example, bycutting off a portion hidden by the thumb when holding the informationprocessing apparatus (housing), and the operation stick may be embeddedin the portion.

In addition, in this embodiment, although the touch panel is provided onthe display panel, it does not need to be limited to this. The touchpanel should just be provided so as to detect the touch input (touchoperation) to the display panel. Therefore, the touch panel may beprovided in the rear side of the housing, for example. Furthermore, ifadopting structure that can transmit the touch coordinate data to a CPU,the touch panel may be provided separately from the housing.

Furthermore, although the touch panel is provided in this embodiment, itis not necessary to provide the touch panel. In such a case, anoperation can be performed with the operation stick and the operationbutton.

Furthermore, although this embodiment is described about the informationprocessing apparatus comprising the display panel and the touch panel,it is possible to also make an information processing apparatus functionas an input device such as a controller by not providing the displaypanel.

Furthermore, although all the information processing such as a gameprocessing is performed in the information processing apparatus in thisembodiment, only a part of the information processing may be performed.For example, the information processing apparatus may perform processingthat receives and outputs the image data (picture image data) and sounddata that are transmitted from other information processing apparatusessuch as a computer or a game apparatus, or processing that outputs(transmits) the operation input from the operation stick, the operationbutton and the touch panel to other information processing apparatuses,or both the processing.

Furthermore, although the housing is constituted by the first portionand the grip portions in this embodiment, there may not be any gripportion.

Furthermore, although a case where the help processing, the replay(reproduction) processing, the character input processing and thecorrection processing can be performed during the game of the embodimentis described in this embodiment, it is not necessary to make all ofthese processing (functions) be performed during the game, only one ortwo or more thereof may be performed.

As mentioned above, the display panel is formed in approximatelyelliptical form in a certain aspect of this embodiment. In this case,for example, the first rim portion along at least the arc portion of thedisplay panel is formed.

Furthermore, in a further aspect of this embodiment, the both right andleft end portions of the display panel are formed in a form ofapproximately semi-circle.

Furthermore, the display panel is formed in approximately track form ina further aspect of this embodiment.

Furthermore, in a further aspect of this embodiment, the first operationunit has an operation portion and a detection portion, and the size ofthe operation portion of this first operation unit is made larger thanthe hole for penetrating the display panel.

Furthermore, as mentioned above, in a further aspect of this embodiment,the object is displayed near the operation portion, and is the guidedisplay corresponding to the operation portion. For example, the image(text image is included) that indicates the operation content (thecontent of instructions), the operation method, etc. of the operationportion is displayed.

Furthermore, in a further aspect of this embodiment, the informationprocessing apparatus further comprises the second operation unit havingthe second operation portion located on the surface of the housing thatis different from the surface that the display panel is provided. Theobjects are respectively displayed near the first operation portion thatis the operation portion of the first operation unit and the secondoperation portion that is the operation portion of the second operationunit, and are the guide displays corresponding to the first operationportion and the second operation portion. For example, the images (textimage is included) that indicate the operation content (the content ofinstructions), the operation method, etc. of the first operation portionand the second operation portion are displayed.

Furthermore, in a further aspect of this embodiment, the object can beselected by the direction input of the operation portion. For example,the object that is displayed in the direction being pointed is selected.

In a further aspect of this embodiment, the information processingapparatus further comprises the touch panel that can detect the touchinput to the display panel. A first operation determining module isconfigured to determine whether the operation portion is currentlyoperated. A touch input invalidating module is configured to invalidatethe touch input from the touch panel when it is determined by the firstoperation determining module that the operation portion is currentlyoperated.

In a further aspect of this embodiment, the information processingapparatus further comprises the touch panel that can detect the touchinput to the display panel. A first operation determining module isconfigured to determine whether the operation portion is currentlyoperated. A touch input invalidating module is configured to invalidatethe touch input within the predetermined range of the circumference ofthe operation portion if the touch input from the touch panel existswhen it is determined by the first operation determining module that theoperation portion is currently operated.

In a further aspect of this embodiment, the information processingapparatus further comprises the touch panel that can detect the touchinput to the display panel. A touch input determining module isconfigured to determine whether the touch input is currently performedin the touch panel. A first operation invalidating module is configuredto invalidate the operation input from the first operation unit when itis determined by the touch input determining module that the touch inputis currently performed.

In a certain aspect of this embodiment, the information processingapparatus comprises the housing having the display panel, the operationunit having the operation portion and the detection portion, and thedisplay control module configured to display a virtual space on thedisplay panel, wherein the operation unit is provided in a manner thatthe detection portion is located in the housing and the operationportion penetrates the display panel to be exposed outside the housing.For example, the display control module is configured to operate theobject in the virtual space corresponding to the operation input fromthe operation unit.

In a further aspect of this embodiment, the information processingapparatus comprises the housing having the touch panel, and the firstoperation unit having the operation portion and the detection portionwherein the first operation unit is provided in a manner that thedetection portion is located in the housing and the operation portionpenetrates the touch panel to be exposed outside the housing.

In a further aspect of this embodiment, the information processingapparatus comprises the housing having the touch panel, and the firstoperation unit that is provided in a hole formed in the touch panel.

In a further aspect of this embodiment, the information processingapparatus comprises the housing having the display panel that is formedwith a hole or notch, and the operation unit having the operationportion and the detection portion, wherein the operation unit isprovided in a manner that the operation portion is exposed outside thehousing from the hole or notch of the display panel.

In a further aspect of this embodiment, the information processingapparatus comprises the display panel, and the operation unit having theoperation portion and the detection portion, wherein the operation unitis provided in a manner that the detection portion is located inside theinformation processing apparatus and the operation portion penetratesthe display panel to be exposed outside the information processingapparatus.

In a further aspect of this embodiment, the information processingapparatus comprises the housing having the display panel, and theoperation unit that is provided to be projected from the rear side tothe front side of the display panel.

In a further aspect of this embodiment, the information processingapparatus comprises the housing having the display panel, and theoperation unit embedded in the display panel.

Although certain example systems, devices and apparatuses have beendescribed herein, it is to be understood that the appended claims arenot to be limited to the systems, devices and apparatuses disclosed, buton the contrary, are intended to cover various modifications andequivalent arrangements included within the spirit and scope of theappended claims.

What we claimed is:
 1. A game apparatus, comprising: a housing having adisplay panel that displays at least a virtual game space; and anoperation unit having an operation portion and a detection portion,wherein the operation unit penetrates the display panel, the detectionportion is located inside the housing, and the operation portion isexposed outside the housing.
 2. An information processing apparatus,comprising: a housing having a display panel; and a first operation unithaving an operation portion and a detection portion, wherein the firstoperation unit penetrates the display panel, the detection portion islocated inside the housing, and the operation portion is exposed outsidethe housing.
 3. The information processing apparatus according to claim2, wherein the display panel has a hole through which the operation unitpenetrates.
 4. The information processing apparatus according to claim2, wherein the operation portion is partially provided above the displaypanel in a thickness direction of the housing, and the detection portionis provided below the display panel, said thickness direction beingperpendicularity to a display surface of the display panel.
 5. Theinformation processing apparatus according to claim 2, wherein thedisplay panel is an oblong form approximately.
 6. The informationprocessing apparatus according to claim 2, wherein each of left andright end portions of the display panel is a form of an arc.
 7. Theinformation processing apparatus according to claim 2, wherein a size ofa front surface of the housing approximately corresponds to a size ofthe display panel, and the display panel constitutes the front surfaceof the housing.
 8. The information processing apparatus according toclaim 5, wherein the display panel is approximately elliptical form,further comprising a first rim portion along at least an arc portion ofthe display panel.
 9. The information processing apparatus according toclaim 5, further comprising a third rim portion close to one long sideof the display panel, the third rim portion being larger than a secondrim portion along the other long side of the display panel.
 10. Theinformation processing apparatus according to claim 5, furthercomprising a fourth rim portion that is formed along one long side ofthe display panel.
 11. The information processing apparatus according toclaim 2, further comprising a touch panel capable of detecting a touchinput to the display panel and a position in a display area of thedisplay panel corresponding to the touch input.
 12. The informationprocessing apparatus according to claim 11, wherein the operation unitalso penetrates the touch panel and the operation portion is exposedoutside the housing.
 13. The information processing apparatus accordingto claim 2, further comprising a second operation unit having anoperation portion located on a surface of the housing different from thesurface on which the display panel is provided.
 14. The informationprocessing apparatus according to claim 2, wherein the first operationunit is provided in the display panel apart from a center portionthereof.
 15. The information processing apparatus according to claim 14,further comprising a third operation unit having an operation portionand a detection portion, wherein the third operation unit penetrates thedisplay panel, the detection portion is located inside the housing, theoperation portion is exposed outside the housing, and the firstoperation unit and the third operation unit are provided in a left sidearea and a right side area of the display panel, respectively.
 16. Theinformation processing apparatus according to claim 15, wherein thefirst operation unit and the third operation unit are provided in a leftend portion and a right end portion of the display panel, respectively.17. The information processing apparatus according to claim 2, whereinthe information processing apparatus is a hand-held type.
 18. Theinformation processing apparatus according to claim 1, wherein theoperation portion of the first operation unit is provided in a rangethat a thumb of a user is placed when holding the housing.
 19. Theinformation processing apparatus according to claim 2, wherein the firstoperation unit can perform a direction input by tilting or sliding theoperation portion.
 20. The information processing apparatus according toclaim 2, wherein the first operation unit can perform a depression inputby pushing down the operation portion.
 21. The information processingapparatus according to claim 2, wherein the first operation unit canperform a direction input in 360 degrees.
 22. The information processingapparatus according to claim 2, further comprising a virtual spacedisplay module configured to display on the display panel a virtualspace image captured by a virtual camera.
 23. The information processingapparatus according to claim 2, further comprising an initial screendisplay module configured to display an initial screen on the displaypanel according to an operation input by the operation portion.
 24. Theinformation processing apparatus according to claim 2, furthercomprising an operation button display module configured to display acontent in a center portion of the display panel, and to display anoperation button concerning operating the content near or around theoperation portion on the display panel.
 25. The information processingapparatus according to claim 2, further comprising a motion detectionmodule configured to detect a motion of the housing.
 26. The informationprocessing apparatus according to claim 25, wherein the motion detectionmodule includes at least one of an acceleration sensor and a gyrosensor.
 27. The information processing apparatus according to claim 2,further comprising a vibrator configured to apply vibration to thehousing.
 28. The information processing apparatus according to claim 2,further comprising an object display module configured to display anobject near the operation portion.
 29. The information processingapparatus according to claim 2, further comprising an object displaymodule configured to display an object around the operation portion. 30.The information processing apparatus according to claim 28, furthercomprising a touch panel capable of detecting a touch input to theobject on the display panel.
 31. The information processing apparatusaccording to claim 30, wherein the object is supplementally displayednear the operation portion.
 32. The information processing apparatusaccording to claim 28, wherein the object is a character, a figure or asign or symbol and can be selected by a direction input of the operationportion.
 33. The information processing apparatus according to claim 28,wherein the object includes an operation history concerning theoperation portion.
 34. The information processing apparatus according toclaim 28, further comprising a second operation unit having a secondoperation portion located in a surface different from the surface onwhich the display panel is provided, wherein the object includesoperation histories concerning the first operation portion and thesecond operation portion.
 35. The information processing apparatusaccording to claim 28, wherein the object is an image effect.
 36. Theinformation processing apparatus according to claim 2, furthercomprising a screen display module configured to display a screen of anapplication on the display panel, wherein the screen display modulechanges a size of the screen to be displayed on the display panelaccording to a kind of the application or a kind of a screen used in theapplication.
 37. The information processing apparatus according to claim3, further comprising a generating module configured to generate imagedata corresponding to a display screen to be displayed on the displaypanel, wherein the generating module generates the image datairrespective of the presence or absence of a hole of the display panel.38. An information processing apparatus, comprising: a housing having adisplay panel having a hole; and a first operation unit that is at leastpartially provided in the hole.
 39. An information processing apparatus,comprising: a housing having a display panel; and an operation unit thatis provided in a manner that at least a part thereof is embedded insidethe housing and penetrates the display panel.
 40. An informationprocessing apparatus, comprising: a housing having a display panel; andan operation unit that is surrounded by the display panel when viewingfrom a front side and penetrates the display panel.
 41. An informationprocessing apparatus, comprising: a housing having a display panel; andan operation unit having an operation portion and a detection portion todetect an input by the operation portion, wherein the operation unit issurrounded by the display panel, the detection portion is located insidethe housing, and the operation portion is exposed outside the housing.42. The information processing apparatus according to claim 41, whereinthe display panel has a hole or notch through which the operation unitpenetrates.